
==================================================
Testing Query: What is the Book of Roles?
==================================================
🔍 [RAG RETRIEVER] Searching with top_k=5, threshold=0.0
   📂 Loading FAISS index...
DEBUG: Loading FAISS index from data/embeddings/faiss_index/faiss.index
DEBUG: Index loaded with 2420 vectors
   📊 Index contains 2420 vectors
   🔤 Embedding query: 'What is the Book of Roles?'
   📈 Scores: max=0.7701, avg=0.6849, candidates=5
   ✅ Found 5 documents above threshold
      📄 [1] Score: 0.7701 | Source: book_of_roles.txt
          Content: The Book of Roles is a comprehensive collection of documents that defines the career model, roles, responsibilities, and competencies for all employee...
      📄 [2] Score: 0.7119 | Source: CTW-2024-DOC-00036-book-of-roles-main-body.pdf
          Content: Book of Roles · 3 Classification Level: InternalOur Book of Roles Our Book of Roles represents what we  must do to make our company successful.  We be...
      📄 [3] Score: 0.6869 | Source: CTW-2024-DOC-00036-book-of-roles-main-body.pdf
          Content: Book of Roles · 5 Classification Level: InternalBook of Roles Architecture The book of roles is designed as a set of documents  that together define t...
      📄 [4] Score: 0.6336 | Source: CTW-2024-DOC-00036-book-of-roles-main-body.pdf
          Content: Book of Roles · 25 Classification Level: InternalCTW-2024-DOC-00036Get ready  for a journey  like no other!...
      📄 [5] Score: 0.6221 | Source: CTW-2024-DOC-00036-book-of-roles-main-body.pdf
          Content: Book of Roles · 24 Classification Level: InternalRevision History Version Date Description Reviewer ... September 2018Boof of Roles, edition 1  Deprec...
Stats: {
  "max_score": 0.7701289653778076,
  "avg_score": 0.6849289059638977,
  "count": 5,
  "total_searched": 2420,
  "threshold_used": 0.0
}
Found 5 results.

--- Result 1 (Score: 0.7701) ---
Source: book_of_roles.txt
Page: 1
Content: The Book of Roles is a comprehensive collection of documents that defines the career model, roles, responsibilities, and competencies for all employees within the organization. It serves as the single...

--- Result 2 (Score: 0.7119) ---
Source: CTW-2024-DOC-00036-book-of-roles-main-body.pdf
Page: 3
Content: Book of Roles · 3
Classification Level: InternalOur Book of Roles
Our Book of Roles represents what we 
must do to make our company successful. 
We believe that success goes hand in 
hand with creatin...

--- Result 3 (Score: 0.6869) ---
Source: CTW-2024-DOC-00036-book-of-roles-main-body.pdf
Page: 5
Content: Book of Roles · 5
Classification Level: InternalBook of Roles Architecture
The book of roles is designed as a set of documents 
that together define the entire Critical TechWorks 
career model (see Fi...

--- Result 4 (Score: 0.6336) ---
Source: CTW-2024-DOC-00036-book-of-roles-main-body.pdf
Page: 25
Content: Book of Roles · 25
Classification Level: InternalCTW-2024-DOC-00036Get ready 
for a journey 
like no other!...

--- Result 5 (Score: 0.6221) ---
Source: CTW-2024-DOC-00036-book-of-roles-main-body.pdf
Page: 24
Content: Book of Roles · 24
Classification Level: InternalRevision History
Version Date Description Reviewer
... September 2018Boof of Roles, edition 1 
Deprecated CTW-2019-
DOC-00018, version 6.2.Several cont...

==================================================
Testing Query: give me more details about critical techworks
==================================================
🔍 [RAG RETRIEVER] Searching with top_k=5, threshold=0.0
   📊 Index contains 2420 vectors
   🔤 Embedding query: 'give me more details about critical techworks'
   📈 Scores: max=0.6390, avg=0.5991, candidates=5
   ✅ Found 5 documents above threshold
      📄 [1] Score: 0.6390 | Source: CTW-2024-DOC-00040-book-of-roles-techops.pdf
          Content:  to results, concise and assertive on problems.  • Manage expectations and communicate clearly  based on data and sound arguments.  • Develop trust an...
      📄 [2] Score: 0.6282 | Source: CTW-2024-DOC-00038-book-of-roles-corpops.pdf
          Content: f doing things.   • Inspire Critical TechWorks to do significantly better.  ...
      📄 [3] Score: 0.6212 | Source: CTW-2020-PCS-00007-book-culture.pdf
          Content: ntries found.     Figure 1  Critical TechWorks Culture Representation   ...
      📄 [4] Score: 0.5567 | Source: CTW-2024-DOC-00037-book-of-roles-manops.pdf
          Content: e entire Critical TechWorks career  model (see Figure 1). The “Main Body” introduces the  role concept, proficiencies, and career model that apply  to...
      📄 [5] Score: 0.5504 | Source: CTW-2024-DOC-00037-book-of-roles-manops.pdf
          Content: IN THIS SECTION,   WE LIST ROLES THAT ARE NOT A DIRECT  PART OF CRITICAL TECHWORKS BUT  RELATE TO ROLES THAT INTERACT  WITH US ON A REGULAR BASIS.STAK...
Stats: {
  "max_score": 0.6390063762664795,
  "avg_score": 0.5991144895553588,
  "count": 5,
  "total_searched": 2420,
  "threshold_used": 0.0
}
Found 5 results.

--- Result 1 (Score: 0.6390) ---
Source: CTW-2024-DOC-00040-book-of-roles-techops.pdf
Page: 11
Content:  to results, concise and assertive on problems. 
• Manage expectations and communicate clearly 
based on data and sound arguments. 
• Develop trust and promote win-win negotiations. 
• Develop Critica...

--- Result 2 (Score: 0.6282) ---
Source: CTW-2024-DOC-00038-book-of-roles-corpops.pdf
Page: 7
Content: f doing things.  
• Inspire Critical TechWorks to do significantly better.  ...

--- Result 3 (Score: 0.6212) ---
Source: CTW-2020-PCS-00007-book-culture.pdf
Page: 4
Content: ntries found.  
 
Figure 1  Critical TechWorks Culture Representation  
...

--- Result 4 (Score: 0.5567) ---
Source: CTW-2024-DOC-00037-book-of-roles-manops.pdf
Page: 3
Content: e entire Critical TechWorks career 
model (see Figure 1). The “Main Body” introduces the 
role concept, proficiencies, and career model that apply 
to all roles. A separate document describes the role...

--- Result 5 (Score: 0.5504) ---
Source: CTW-2024-DOC-00037-book-of-roles-manops.pdf
Page: 4
Content: IN THIS SECTION,  
WE LIST ROLES THAT ARE NOT A DIRECT 
PART OF CRITICAL TECHWORKS BUT 
RELATE TO ROLES THAT INTERACT 
WITH US ON A REGULAR BASIS.STAKEHOLDERS...

==================================================
Testing Query: what is data mastermind
==================================================
🔍 [RAG RETRIEVER] Searching with top_k=5, threshold=0.0
   📊 Index contains 2420 vectors
   🔤 Embedding query: 'what is data mastermind'
   📈 Scores: max=0.7403, avg=0.6975, candidates=5
   ✅ Found 5 documents above threshold
      📄 [1] Score: 0.7403 | Source: CTW-2024-DOC-00039-book-of-roles-devops.pdf
          Content: ontributes to the continuous improvement of  Data Mastermind practices and the role.  • Works self-guided, but always with CTW’s core values  and work...
      📄 [2] Score: 0.7206 | Source: CTW-2024-DOC-00039-book-of-roles-devops.pdf
          Content: e Data Mastermind is a  DevOps team member responsible for both  Development and Operations activities. Develop · Insights · Run Data Mastermind·Role·...
      📄 [3] Score: 0.7029 | Source: CTW-2024-DOC-00039-book-of-roles-devops.pdf
          Content: Book of Roles · DevOps  · 13 Classification Level: InternalThe Data Mastermind (DMM) plays a  crucial role in designing, developing, building,  testin...
      📄 [4] Score: 0.6940 | Source: CTW-2024-DOC-00039-book-of-roles-devops.pdf
          Content:  ones to know of.  At this level, a Data Mastermind also contributes  to the team’s efficiency and maturity by  following the established working mode...
      📄 [5] Score: 0.6298 | Source: CTW-2024-DOC-00039-book-of-roles-devops.pdf
          Content: l  things to be known are available at the  touch of a button. They are the plumbers  who build reliable and puncture-proof data  pipelines. Still, th...
Stats: {
  "max_score": 0.7403448820114136,
  "avg_score": 0.6975236654281616,
  "count": 5,
  "total_searched": 2420,
  "threshold_used": 0.0
}
Found 5 results.

--- Result 1 (Score: 0.7403) ---
Source: CTW-2024-DOC-00039-book-of-roles-devops.pdf
Page: 15
Content: ontributes to the continuous improvement of 
Data Mastermind practices and the role. 
• Works self-guided, but always with CTW’s core values 
and working model as a reference and guiding light.  
• Ac...

--- Result 2 (Score: 0.7206) ---
Source: CTW-2024-DOC-00039-book-of-roles-devops.pdf
Page: 13
Content: e Data Mastermind is a 
DevOps team member responsible for both 
Development and Operations activities. Develop · Insights · Run Data Mastermind·Role·  
Capabilities
• Logical and structured thinking....

--- Result 3 (Score: 0.7029) ---
Source: CTW-2024-DOC-00039-book-of-roles-devops.pdf
Page: 13
Content: Book of Roles · DevOps  · 13
Classification Level: InternalThe Data Mastermind (DMM) plays a 
crucial role in designing, developing, building, 
testing, deploying, running, and maintaining 
software s...

--- Result 4 (Score: 0.6940) ---
Source: CTW-2024-DOC-00039-book-of-roles-devops.pdf
Page: 14
Content:  ones to know of. 
At this level, a Data Mastermind also contributes 
to the team’s efficiency and maturity by 
following the established working model and 
work agreements. They speak when disagreein...

--- Result 5 (Score: 0.6298) ---
Source: CTW-2024-DOC-00039-book-of-roles-devops.pdf
Page: 13
Content: l 
things to be known are available at the 
touch of a button. They are the plumbers 
who build reliable and puncture-proof data 
pipelines. Still, they can also be painters 
and storytellers who are ...
